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The MAILING DATE of this communication appears on the cover sheet with the correspondence address 
Period for Reply 

A SHORTENED STATUTORY PERIOD FOR REPLY IS SET TO EXPIRE 3 MONTH(S) FROM 
THE MAILING DATE OF THIS COMMUNICATION. 

- Extensions of time may be available under the provisions of 37 CFR 1 . 1 36(a). In no event, however, may a reply be timely filed 
after SIX (6) MONTHS from the mailing date of this communication. 

- If the period for reply specified above is less than thirty (30) days, a reply within the statutory minimum of thirty (30) days will be considered timely 

- If NO period for reply is specified above, the maximum statutory period will apply and will expire SIX (6) MONTHS from the mailing date of this communication 

- Failure to reply within the set or extended period for reply will, by statute, cause the application to become ABANDONED (35 U S C § 1 33) 

- Any reply received by the Office later than three months after the mailing date of this communication, even if timely filed may reduce any 
earned patent term adjustment. See 37 CFR 1 .704(b). 

Status 

1 )^ Responsive to communication(s) filed on 25 January 2002 . 
2a)D This action is FINAL. 2b)|EI This action is non-final. 

3) D Since this application is in condition for allowance except for formal matters, prosecution as to the merits is 

closed in accordance with the practice under Ex parte Quayle, 1935 CD. 1 1 , 453 O.G. 213. 
Disposition of Claims 

4) E3 Claim(s) 1-23 is/are pending in the application. 

4a) Of the above claim(s) is/are withdrawn from consideration. 

5) Q Claim(s) is/are allowed. 

6) IEI Claim(s) 1^23 is/are rejected. 

7) D Claim(s) is/are objected to. 

8) D Claim(s) are subject to restriction and/or election requirement. 

Application Papers 

9) D The specification is objected to by the Examiner. 

10)13 The drawing(s) filed on 18 September 1999 is/are: a)D accepted or b)E3 objected to by the Examiner. 



If approved, corrected drawings are required in reply to this Office action. 

12) D The oath or declaration is objected to by the Examiner. 
Priority under 35 U.S.C. §§119 and 120 

13) Q Acknowledgment is made of a claim for foreign priority under 35 U.S.C. § 119(a)-(d) or (f). 

a)DAII b)D Some*c)D None of: 

1 .□ Certified copies of the priority documents have been received. 

2. Q Certified copies of the priority documents have been received in Application No. . 

3. D Copies of the certified copies of the priority documents have been received in this National Stage 

application from the International Bureau (PCT Rule 17.2(a)). 
* See the attached detailed Office action for a list of the certified copies not received. 

14) |EI Acknowledgment is made of a claim for domestic priority under 35 U.S.C. § 119(e) (to a provisional application). 

a) □ The translation of the foreign language provisional application has been received. 

15) D Acknowledgment is made of a claim for domestic priority under 35 U.S.C. §§ 120 and/or 121. 

Attachment(s) 

1 ) K Notice of References Cited (PTO-892) 4) □ Interview Summary (PTO-41 3) Paper No(s). . 

2) ^ Notice of Draftsperson's Patent Drawing Review (PTO-948) 5) Q Notice of Informal Patent Application (PTO-152) 

3) [3 Information Disclosure Statements) (PTO-1449) Paper No(s) 4,6.8 . 6) O Other: 



Applicant may not request that any objection to the drawing(s) be held in abeyance. See 37 CFR 1 .85(a). 
1 !)□ The proposed drawing correction filed on is: a)D approved b)D disapproved by the Examiner. 
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DETAILED ACTION 

1 . This action is responsive to communications: Application received 9/15/1999; and 

1. D.S.'s filed on 11/21/2000 1/25/2002 and 12/27/2002. 

2. Claims 1-23 are pending in the case. Claims 1, 7, 10, 13, and 20 are independent claims. 

Drawings 

3. The drawings were objected to by the draftsperson, please see attached form PTO-948. 

Claim Rejections - 35 USC § 112 

4. The following is a quotation of the second paragraph of 35 U.S.C 1 12: 

The specification shall conclude with one or more claims particularly pointing out and distinctly claiming the 
subject matter which the applicant regards as his invention. 

5. Claims 1-6 are rejected under 35 U.S.C. 112, second paragraph, as being indefinite for 
failing to particularly point out and distinctly claim the subject matter which applicant regards as 
the invention. 

Regarding independent claim 1, the claim language is indefinite as to the relationship between 
the plurality of annotations and the plurality of media streams. From the specification it appears 
the applicant's invention pertains to a specific set of annotations being correlated to a specific 
piece of media, which is available as plurality of different media streams. The current claim 
language does not make that clear. For examining purposes only the above meaning will be 
considered. 

Regarding dependent claims 2-6, the claims are rejected for fully incorporating the deficiencies 
of the base claim. 
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Regarding dependent claim 3, it is unclear from the claim language and page 14, lines 12-20 as 
to the meaning of "time-compressed." For examining purposes only, the phase is interpreted to 
mean that the stream is played at a normal speed, but is a lower quality stream. 

Claim Rejections - 35 USC §101 

6. 35 U.S.C. 101 reads as follows: 

Whoever invents or discovers any new and useful process, machine, manufacture, or composition of matter, or 
any new and useful improvement thereof, may obtain a patent therefor, subject to the conditions and 
requirements of this title. 

7. Claims 10-12 are rejected under 35 U.S.C. 101 because the claimed invention is directed 
to non-functional descriptive data stored on a medium. 

Claim Rejections - 35 USC § 103 

8. The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set forth in 
section 102 of this title, if the differences between the subject matter sought to be patented and the prior art are 
such that the subject matter as a whole would have been obvious at the time the invention was made to a person 
having ordinary skill in the art to which said subject matter pertains. Patentability shall not be negatived by the 
manner in which the invention was made. 

9. Claims 1-12 are rejected under 35 U.S.C. 103(a) as being unpatentable over 
"Synchronized Multimedia Integration Language (SMIL) 1.0 Specification," W3C 
Recommendation 15-June-1998, herein referred to as W3C, in view of deVries et al. (USPN 
6332144— (priority date 3/11/1998). 

Regarding independent claim 1 5 W3C discloses a system (p.26, ex. 4) for associating 
annotations, contained in the <text . . . /> tag, to the plurality of media streams, representing 
different versions of multimedia content, that would be contained in ellipses found at lines 6, 9, 
and 12 of the example, as explained in the header of the example. While there is no explicit 
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mention of annotations and multimedia servers, W3C does however disclose that both the 
annotations and media are referenced by a URI (p. 19, "src"), which were well-known to refer to 
servers. deVries et al. (deVries) discloses that media and annotations can be stored on servers 
(FIG IB, 22 and 26), the annotation server inherently having a database of annotations. 
Therefore it would have been obvious to one of ordinary skill in the art at the time of the 
invention to combine deVries and W3C in order to effectively store the annotations, media, and 
relations between the two. 

Regarding dependent claim 2, deVries discloses the streams can be audio or video (col. 1, 11. 



Regarding dependent claim 3, W3C discloses different time compressed versions (p. 26, ex. 2). 
Regarding dependent claim 4, W3C discloses versions having different resolutions (p. 26, ex. 



Regarding dependent claim 5, W3C discloses an identifier for each of the plurality of media 
streams (p. 19, "src"). 

Regarding dependent claim 6, W3C discloses the identifier is a URI (p. 19, "src") equivalent to 



Regarding independent claim 7, W3C discloses an SMIL document that correlates an 
annotation with different versions of the same multimedia content as described in the rejection of 
claim 1 . It is the position of the Office that a data structure is equivalent to an XML document 
such as a SMIL. W3C does not disclose storing the annotation. deVries discloses a storage 
device to store the annotation (FIG. IB, 26). It would have been obvious to combine deVries 



59-61). 



a URL. 
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and W3C to store the annotation so that it is correlated through the data structure by storing the 
annotation in the storage device at the location referenced by the URI in the <text/> tag. 
Regarding dependent claim 8, W3C discloses a version list identifying multiple different 
versions (p.26, ex. 4). 

Regarding independent claim 10, W3C teaches a data field representing an annotation 
corresponding to multimedia content, and a data field correlated so that the field identifies a 
plurality of different versions of the multimedia content to which the annotation corresponds 
(p.26, ex. 4). 

Regarding dependent claim 11, W3C teaches that identifiers are intended to be included at the 
ellipses in example 4, on page 26. 

Regarding dependent claim 9 and 12, W3C teaches that URFs, equivalent to URL's are 
intended to be included at the ellipses in example 4, on page 26. 

10. Claims 13-20, 22, and 23 are rejected under 35 U.S.C. 103(a) as being unpatentable 
over W3C in view of Klemets et al. (USPN 6449653— field 3/25/1997) herein referred to as 
Klemets. 

Regarding independent claim 13, W3C teaches associating an annotation with a set of media 
streams, however, is silent as to the creation of the annotations. Klemets teaches receiving a user 
request to create a new annotation (col. 5, 11. 52-67). It would have been obvious to one of 
ordinary skill in the art at the time of the invention to include a method of creating a new 
annotation, as it would be allow easier addition of annotations. 

Regarding dependent claim 14, W3C does not explicitly disclose associating a new record with 
a previously generated record. W3C does disclose annotations in <par> and <seq> tags (sees. 
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4.2. 1 -.4. 1 .2). Upon the creation of new annotation as recited in claim 1 3, it would have been 
obvious to one of ordinary skill in the art at the time of the invention to associate the annotation 
within the tags to allow the annotation to be synched with the media stream. 
Regarding dependent claim 15, it would have been inherent to identify the streams before 
associating anything with them. 

Regarding dependent claim 16, Klemets discloses a streaming media server, where the media 
is located (col. 4, 11. 36-54). In order to identify the media, there must be communication with 
server. 

Regarding dependent claim 17, W3C discloses a set of identifiers, each identifier uniquely 
identifying one of the sets of streams (p.26, ex. 4). 

Regarding dependent claim 18, W3C discloses a record of the set of media streams (p.26, 
ex.4). It would have been obvious to one of ordinary skill in the art at the time of the invention 
to generate and store this record so that it can be read later. 

Regarding independent claim 20, W3C discloses receiving an indication of the version of 
media content (p. 18, 11 1-3). W3C also discloses that annotations are corresponding to a 
plurality of different versions of the media content, (p. 26, ex. 4). W3C is silent on providing the 
annotations to he the user. Klemets discloses providing the annotations to the user (col. 8, 11. 26- 
34). It would have been obvious to one of ordinary skill in the art at the time of the invention to 
combine W3C and Klemets as the markup language of W3C was intended to describe how 
media should interact with each other when it is displayed. 
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Regarding dependent claim 22, it would have been obvious to one of ordinary skill in the art at 
the time of the invention to compare the identifiers to find out what media the version was a part 
of. 

Regarding dependent claims 19 and 23, the computer programs for executing the methods of 
claims 13 and 20 are rejected under the same rationale. 

11. Claim 21 is rejected under 35 U.S.C. 103(a) as being unpatentable over W3C and 
Klemets as applied to claim 20 above, and further in view of Media Weaver, by Sha Xin 
Wei (6/2/1997). 

Regarding dependent claim 21, Klemets discloses playing an annotation at the proper time 
(col. 8, 11. 59-67). Both W3C and Klemets are silent as to converting media. Xei discloses 
converting media (p. 12 bullet 3). It would have been obvious to one of ordinary skill in the art at 
the time of the invention modify Xei into W3C and Klemets so that the annotations would still 
be presented in the same context as in the original media. 

Conclusion 

12. The prior art made of record and not relied upon is considered pertinent to applicant's 
disclosure. 

• USPN 6438566 to Okuno et al. 

• "Synchronized Multimedia Integration Language (SMIL) 1.0 Specification," W3C 
Recommendation 15-June-1998, http://www.w3.org/TR/1998/REC-smil-19980615 

• Nerney, Chris, RealNetworks unveils software line for multimedia displays, Network 
World, 5/4/98, http://www.nwfusion.com/news/0504real.html 

• Booker, Eliis, "Microsoft And RealNetworks Wage Media War", Internet Week , July 10, 
1 998, http://www.techweb.com/wire/story/TWB 1 99807 1 0S00 1 4 
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Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to Adam M Queler whose telephone number is (703) 308-5213. 
The examiner can normally be reached on Monday-Friday. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Heather R Herndon can be reached on (703) 308-5186. The fax phone numbers for 
the organization where this application or proceeding is assigned are (703) 746-7239 for regular 
communications and (703) 746-7238 for After Final communications. 

Any inquiry of a general nature or relating to the status of this application or proceeding 
should be directed to the receptionist whose telephone number is (703) 306-5631. 



AQ 

December 30, 2002 




